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VIEW-DEPENDENT DISPLACEMENT MAPPING 

BACKGROUND OF, THE INVENTION ■ • 

The present invention relates to computer 
generated graphics, in particular, the modeling and 
rendering . of realistic graphics, "■' focusing on .fine- , 
scale geometric features and associated visual 
effects': of such features. 

Computer graphics are used' in many 
different applications including computer games, 
movies and web pages. With the capability of more 
powerful computers, realistic graphics are becoming 
more desired in order to provide, a more realistic . 
experience to the computer user. 

Accurate computer rendering of fine : scale 
geometric features and associated visual effects 
yields vivid object appearance . . This level of detail, 
commonly referred to as meso.structure , lies between 
that of meshes, which provide an efficient 
representation of gross shape, and bi-directional 
reflectance functions (BRDFs) that describe the light 
scattering effects of micro-scale material structure . 
The high-frequency visible geometry of mesostructure 
leads to complex visual effects including fine-scale 
shadowing, occlusion and silhouettes. These 
characteristics each ' contribute to realistic 
appearance, but are also difficult to' render 
efficiently. 

Mesostructures are typically rendered using 
techniques such as. bump mapping, horizon mapping or 
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displacement mapping. In summary, bump mapping 
perturbs 'mesh normals to coincide with the geometric 
detail to provide basic shading but not shadowing, 
occlusion, and silhouettes. ' Horizon mapping improves 
realism by adding self -shadows, but occlusion and 
silhouettes are still missing. Displacement mapping 
lacks shadowing, but provides . occlusion and 
silhouettes. In addition, although conventional, 
displacement mapping can be implemented in hardware, 
its performance for mesostructure rendering: is 
limited by the large number of vertices that result 
from the considerable mesh subdivision required. 

An image-based approach to mesostructure 
rendering is .to .sample, surface appearance under 
various lighting and viewing directions. This 
technique is commonly referred to as a bi-directional 
texture function ( "BTF" ) . Although characteristics 
such as shading, self -shadowing and occlusion are 
realized, silhouette characteristics are lacking. 
Simimarly, a polynomial texture map ( " PTM" ) can 
incorporate shading, and self -shadowing attributes, 
but lacks occlusion and silhouettes. 

Accordingly, there is a clear need for 
improvements in realistic, mesostructure computer- 
renderings. Although a new method and. system to 
render mesostructures with shadowing, occlusion and 
silhouette attributes would by itself be beneficial, 
an algorithm, realizing some or all of these features 
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that can be quickly and/or efficiently employed would 
also be beneficial. 

SUMMARY OF THE INVENTION 
One aspect of the present invention 
includes a computer implemented method for generating 
a representation' of structure for use - in rendering a 
synthesized image is provided. The representation is 
a view- dependent displacement mapping that represents 
displacements along a viewing direction. 

The view-displacement representation records a 
distance of each point on the structure from a 
reference surface along a viewing, direction. For a 
given viewing direction V - (9, 0), (being a function of 
at least one angle with respect . to the reference 
surface, which can be expressed in spherical 
coordinates) each reference surface point P with a 
corresponding texture coordinate (x, y) in the map 
projects to a mesostructure surface point P' that has 
texture coordinate Ax', y') . For different viewing 
directions V, P projects onto different points on the' 
structure surface. The view- dependent displacement 
representation can be. organized into a' five- 
dimensional function when a. local' reference surface 
curvature along the viewing direction is included. 

Another aspect of the invention includes 
using . the representation for synthesis. The 
representation is particularly advantageous because 
it can be used to determine self shadows as well as 
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shading, occlusion and silhouettes in the synthesized 
image . 

BRIEF DESCRIPTION OF THE DRAWINGS 
FIG. 1 is a block diagram of an exemplary 
5 .. computing environment for. practicing the present 
* invention. 

FIG. 2 is a- flowchart illustrating a method 
for obtaining and using a . view- dependent displacement 

representation. 
10 FIGS. 3, 5-7 are schematic sectional views, 

of miesostructure surfaces. 

FIG. 4 is pictorial representation of 

texture space. 

FIG. 8 is a flow chart . of a method for 
15 processing a view- dependent displacement 

representation. 

FIG. 9 is a schematic sectional view 
illustrating aspects for rendering a- mesostructure 
surface. 

20 DETAILED DESCRIPTION OF ILLUSTRATIVE EMBODIMENTS 

Prior to discussing the present invention 
in greater detail,- an embodiment of an illustrative 
environment in which the present invention can be 
used Will be discussed. FIG. 1 illustrates an example 

25 of a suitable computing system environment 100 on 
which the invention may be implemented. , The 
computing system environment 100 is only one example 
of a suitable computing, environment and is not 
intended to suggest any limitation as to the scope of 
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use or functionality of the invention. Neither 
should the computing environment 100 be interpreted 
as having any dependency or requirement relating to 
any one or combination of components illustrated in 
5 the exemplary operating environment 100. 

The invention is operational with numerous 
other general purpose or special purpose computing 
system environments or configurations. Examples of' 
well known computing systems, environments, and/or 
10 configurations that may be suitable for use with the 
invention include,, but are not limited to, personal 
computers, server computers, hand-held or laptop 
devices, multiprocessor systems,, microprocessor-based 
systems, set top boxes, programmable consumer 
15 electronics, network PCs, minicomputers, mainframe 
computers, distributed computing environments that 
include any of the above systems or devices, and the 
like . 

The invention may be described in the 
20 general context of computer-executable instructions, 
such as program modules, being executed by a 
computer. Generally, program modules include 

routines, programs, ' Objects, 'components, data 
structures, etc. that perform particular, tasks or 
25 implement particular abstract data types. The 
invention may also be practiced in distributed 
computing environments where tasks are performed by 
remote processing devices that are linked through a 
communications network. In a distributed computing 
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environment, program modules may be located in both 
local and/ remote computer storage media including 
memory storage devices . Tasks performed by the 
programs and modules are described below and with the 
aid of .figures. Those skilled in the art can 
implement the description and figures as processor 
executable instructions, which can be written on any 
form of a computer readable media. 

With reference to FIG. 1, an exemplary 
system for implementing the invention includes a 
general -purpose computing device in the form of a 
computer 110. Components of computer 110 may 

include, but are not limited to, a processing unit 
120, a system memory. 130, and a system bus 121 that 
couples various system components including the 
. system memory to the processing unit 120. The system 
bus 12i may be any of several types of bus structures 
.including a memory bus or memory controller, a 
peripheral bus, and a local bus using any of a 
variety of bus architectures.. By way of example, and 
not limitation, such architectures include Industry 
Standard Architecture (ISA) bus, Micro Channel 
Architecture (MCA) "bus, Enhanced ISA (EISA) bus, 
Video Electronics Standards Association (VESA) local 
bus, and Peripheral Component Interconnect (PCI) bus 
also known as Mezzanine bus. 

" . . Computer 110 typically includes a variety 
of. computer readable media. Computer readable media 
can be any available media that can be accessed by 
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computer 110 and includes both volatile and. 
nonvolatile media, removable and non- removable media. 
By way of example, and not limitation, computer 
readable media may comprise, computer storage media 

and communication media. Computer storage media 

includes both volatile and nonvolatile, removable and 
non-removable media implemented . in any method or 
technology for storage of information such as 
computer readable instructions, data structures, 
program modules or other data . Computer storage 
media includes, but is not limited to, RAM, ROM', 
EE PROM/ flash memory or other memory technology, CD- 
ROM, digital versatile disks. (DVD), or other optical 
.disk storage, magnetic cassettes, magnetic, tape, 
magnetic disk storage or other magnetic storage 
devices, or any other medium which can be used to 
store the desired information and which can be 
accessed by computer 100. . . 

Communication media typically embodies 
.computer readable instructions, ' data structures, 
program modules . or other data in a modulated data 
signal such as a carrier wave or other transport 
mechanism and includes any information .delivery 
media. The term "modulated data signal" means a 
signal that has one or more of its characteristics 
set or changed in . such a manner as to encode 
information in the signal. By way of example, and 

not limitation, communication media includes wired 

media such as a wired network or . direct-wired 



connection, and wireless media such as acoustic, FR, 
infrared and other wireless media. Combinations of 
any of the above should also , be included within the 
scope of computer readable media. 

5 The system memory 130 includes computer 

storage media in the form of volatile and/or 
: nonvolatile memory such as read only memory (ROM) 131 
and random access memory (RAM) 132.. A basic 
input /output system 133 (BIOS), containing the basic 

10 routines that help, to transfer information between 
elements within computer 110, such as during start- 
up, is typically stored in ROM 131. RAM 132 typically 
contains data and/or program modules that are 
immediately accessible to and/or presently being. 

15 operated on by processing unit 120. By way of 
example, and not limitation, FIG. 1 illustrates 
operating system 134, application programs 13 5, other 
program modules 136, and program data 137. 

The computer 110 . may also include other 

20. removable/non^ removable volatile/nonvolatile computer 
storage media. By way of example only, FIG. 1 
illustrates a hard disk drive 141 that reads from or 
writes to non- removable, nonvolatile magnetic media, 
a magnetic disk drive 151 that reads from or writes 

25 to a removable, nonvolatile magnetic disk 152, and an 
optical disk drive 155 that reads from or writes to a 
removable, nonvolatile optical disk 156 such as a CD* 
ROM or other optical media. Other removable/non- 
removable, volatile/nonvolatile computer storage 
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media that can be used in the' exemplary operating 
environment include, but are not limited to, magnetic 
tape cassettes, flash memory cards, digital versatile 
disks, digital video tape, solid state RAM, solid 

5 state ROM, and the like. The hard disk drive 141 is 
typically connected to the system bus 121 through a 
non- removable memory interface such as interface 14 0, 
and magnetic disk drive 151 and optical disk drive 
155 are typically connected to the system bus 121 by 

10 a removable memory interface, such as interface 150. 

The drives and their associated computer 
storage media discussed above and illustrated in FIG. 
. . 1, provide storage of computer readable instructions, 
data structures, program modules and other data for 

15 the computer 110. In FIG. 1, for example, hard disk 
drive 141 is illustrated as storing operating system 
144, application programs 145, other program modules 
14 6, and program data 147. Note that these components 
can either be the same as or different from operating 

20 system 134, application programs 135, other program 
modules 136, and program data 137. Operating system 
144, application programs 145, other program modules 
146, and program data 147 are given different numbers 
here to illustrate that, at a minimum, they are 

25 different copies. . 

A user may enter commands and information 
into the computer 110 through input devices such as a 
keyboard 162, a microphone 163, and a pointing device 
161, such as a mouse, trackball or touch pad. Other 



input devices (not shown) may include a joystick, 
game pad, satellite dish, scanner, or the like. 
These and other input devices are often connected to 
the processing unit 120 through a user input 
5 interface 16 0 that is coupled to the system bus, but 
may be connected by other interface and bus 
structures, such as a parallel port, game port or a 
universal serial bus (USB) . A monitor 191 or other 
type of display device is also connected to the 

.10 system bus 121 via an interface, such as a video 
interface 190.* In addition to the monitor, computers 
may also include other peripheral output devices such 
as speakers 197 and printer 196, which may be 
connected through an output peripheral interface 190. 
15 . The computer 110 may operate in a networked 

environment using logical connections to one or more 
remote computers, such as a remote computer 180. The 
remote computer 180 may be a personal computer, a 
hand-held device, a server, a router, a network PC, a 
20 peer device or other common network node, and 
typically includes many or all of the elements 
described above relative to the , computer 110. The 

.'■ — logical connections depicted in FIG. 1 . include a 
local area network (LAN) 171 and a wide area network 
25 (WAN) 173, but may also include other networks. Such 
networking environments are commonplace in offices, 
enterprise-wide computer networks, intranets and the 
Internet. 
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When used in a LAN networking environment, 
' the computer 110 is connected to the LAN 171 through 
a network interface or adapter .170 . When used in a 
WAN networking environment/ the computer 110 

5 typically includes a modem 172 or other means for 
establishing communications over the WAN i73, such as 
the Internet. The modem 172, which may be internal 
or external, may be connected to the 'system bus' 121 
via the user input interface 160, or other. 

10 appropriate mechanism. In a networked environment, 
program modules depicted relative to the computer 
110, or portions thereof,, may be stored in the remote 
- memory , storage, device. By way of example, and not 
limitation, FIG. 1 illustrates remote application. 

15. programs 185 as residing on remote computer 180. It 
will be appreciated that the network connections 
shown are exemplary and other means of establishing a 
communications link between the computers may be 
used. 

20. In general, an aspect of the present invention 

comprising a method of structure rendering is 
illustrated in FIG. 2 at 200 and includes two general 
steps 202= and 204.. At step ' 202, a textured height 
field sample or distribution is . accessed and 

25 converted to a view-dependent mapping ("VDM") or 
representation. At step 204, the VDM representation 
is used for rendering such as by a per-pixel 
algorithm that can be implemented in hardware. 
Details regarding these steps are provided below. 
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Aspects of step 202 are illustrated in FIG. 3. A 
textured height field sample or distribution (herein 
also "mesostructure") is indicated at 300. A 
reference surface 302 is used to create a view- 

5 dependent displacement map 400 illustrated in FIG. 4. 
The view-displacement map or representation 400 
records a distance 402 of each point on the 
. mesostructure 3 00 from the reference surface 3 02 
along a viewing direction 304, as . illustrated in FIG-. 

10 3. For a given viewing direction 304 V = (0,O), (being a 
function of at least one angle with respect to the 
reference surface 302, which can be expressed in 
spherical coordinates) each reference surface point P 
with a corresponding texture coordinate (x, y) in map 

15 400 projects- to a mesostructure surface point P' that 
has texture coordinate (x', y') . It should be noted, 
for different viewing directions V, P clearly would 
project onto different . points on mesostructure 
surface 300, so a displacement value d (herein along 

20 or substantially parallel to the viewing direction V) 
is dependent on Z^y^A • Generally, d is but one view- 
dependent displacement parameter that can be used, 
other parameters that are also- a function of viewing 
directions such as h or 1 could equivaleritly be used 

25 to represent a view- displacement parameter; however, 
d is less affected by sampling errors that would 
arise at viewing directions close to a surface normal 
or tangent of the reference surface 302. 



The foregoing provides an illustrative example 
where the mesostructure 300 is generally , planar;, 
however, in many instances a local curvature of the 
mesostructure 300, which can also be a mesh surface, 

5 also affects the projection points. Pp', Pi 1 , P 2 ' ... P nT i ' 
for different view directions V 0 , V 1; . V 2 ... ; V^i- ' When 
displacements for a flat reference surface 302 as 
illustrated in FIG. 5 are mapped onto a curved 
surface ,602 as FIG. 6, the displacements d (P to P* ); 

10 .are no longer correct, and for some viewing 
directions such as V n _ x there does not even exist an 
intersection with the mesostructure . surface 300./ 
Curvature is generally, ignored in other rendering* 
algorithms such as bump mapping, horizon mapping, BTF 

15 and PTM. However,, neglect of this factor can lead to 
inaccurate silhouettes and a warped appearance of the 
mesostructure . 

With the consideration of curvature, view- 
dependent displacement information can be organized 

20 into a f ive-dimensiorfal VDM function d WDM (x> y, 0 5 <M), 
where x, y are the texture coordinates for P on the 
reference surface (FIG. ^4), 0,<|> are the spherical 
angles of the' viewing direction " in 'the * local 
coordinate frame on the reference surface 602,' and c 

25 is the local reference surface curvature along the 
viewing direction. Stated another way, FIG. 6 is a 
sectional view taken along a plane defined by a 
viewing direction (here. V 0 , V X/ V 2 ... V n .! lie in the 
same plane) and. the surface normal at P. This plane 
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will intersect the reference surface 602 along a 
curve, where c is the curvature of: this curve at P. 

If an intersection with the mesostructure 3 00 
exists for (x, y) in direction 0 ? (j> with curvature c, 
5 then the VDM function takes a value (finite distance) 
of the view- dependent displacement d VD M. If the 
intersection does not exist, or stated another way, 
no finite distance exists between the reference 
surface 302 and the mesostructure 300 , then cIvdm is set 
10 to -1. FIG. 7 -illustrates the foregoing . where for 9,, 
dvDM equals 1/sinO,, while for 0 2 , (Ivdm equals -1. In the 
present implementation, the mesostructure surface 300: 
is defined inwards of the reference surface 602, so 
negative displacements are invalid. 
15 In one embodiment, the view-dependent 

mesostructure function is built by first forming a 
fine mesh for a mesostructure with zero curvature, 
and then using a' ray-casting algorithm the view- 
dependent displacement values are calculated. 
20 While it is possible to compute the full 5D 

(five dimensional) view-dependent mesostructure 
' function by forming a mesostructure mesh for various 
curvature values, in one embodiment, a less 
computationally expensive approach is used based on 
25 the zero -curvature mesostructure mesh. 

For ease of explanation, consider a given point 
(x 0 , y 0 ) and azimuth angle (|) 0 of the viewing direction 
• and * that there are n sampled viewing elevation angles 
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(00,6,,.. .,9 M _,) uniformly distributed over (0, U/2) and 
intersecting the microgeometry at points P 0 , Pi, .../ 
P nrlt as shown in FIG; 5.; The displacements of these 
points are used to compute the zero curvature values 

5 of the VDM, and can also be used for calculations of 
other curvatures . 

Bending the zero- curvature microgeometry surface 
to have curvature C = C 0 causes the' zero- curvature 
intersection points to correspond to new viewing - 

10 angles (9^,9j ,...,0^ ) that are no longer a uniform 
sampling. To obtain the VDM values, the non-uniform 
samples are resampled by linear interpolation . 

In the' resampling, process, a couple special 
cases require attention. When the curvature is 

15 positive, some view-dependent displacement values may 
become invalid because no intersection with the 
mesostructure surf ace ( exists, or stated another way, 
no finite distance exists between the reference 
surface 302 and the mesostructure 3 00. In this 

20 instance, the VDM is assigned a value of -1, as 
* indicated above. Another special case occurs when the 
sampled angles become reordered after resampling. 
This. happens when a zero- curvature intersection point 
Y becomes occluded after bending. For this case, the 

25 occluded direction is discarded in the resampling 
operation. 

To efficiently compute the texture offset 
for a curved surface at rendering time, the VDM- 



definition d VD M(^ 9 y, 0 v ,<|) v ,c v ) equals l/sin0 v is used, 
where 1 is the distance between P and P\ in texture 
space and can be geometrically computed from the 
triangle defined by P, P' and the center of 

5 curvature . This extended definition simplifies 
texture of f set * computation for curved surfaces as 
described above. . .. 

After computing a VDM representation for a given 
mesostructure surface at step 2 02 in FIG. 2, it can 

10 be mapped to a new * surface ' as a high-dimensional 
texture at step 2 04. This mapping should result in 
texture coordinates on the object surface that have 
locally uniform scale and little distortion, with the 
mesostructure pattern closely maintained. Since the , 

15 mesostructure is typically a . three-dimensional 
volume, it is also preferred that . its dimensions be 
.scaled equally in the mapping. 

Several property maps such as normal and color 
maps may be generated and accessed, for rendering. 

20 Since all of the maps are defined on the same 
reference surface, they can be applied onto the 
surface of a new object simultaneously. After, 
mapping, one can imagine that the . height field ©re- 
distribution is extended under the object .surface 

25 with locally uniform scale and little distortion. 

To render the VDM representation or 
mapping, the normals of the object surface are 
calculated from the height field. Each surface normal 
and the two orthogonal directions of the, texture 
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define a local coordinate system in which the viewing 

and lighting directions are expressed. 

The parameters of each pixel on, for example, a 

rasterized surface are then computed. The parameters 
5 can include a texture coordinate T = (x, y) , an 

illumination direction L = (0 L ^ L ), a viewing, 

direction V = (0 y ,$ w ) , and local curvatures c v , c L 

along V and L respectively. From the two principal 
- curvature directions C max , C min and their corresponding 
10 curvature values, C max/ C min , the curvature along the 

viewing direction V can be computed as 

c max (V- Cmax )^ + Cmin (V- Cmin ) 
l-(V.N) 2 

The curvature c L - along the lighting direction h 
. is computed similarly. Although the parameters of 

15. each pixel* can be calculated in this manner, in one 
embodiment to reduce computations, the parameters for 
pixels of vertexes of the object surface are 
calculated with interpolation used to find the values 
of parameters of the remaining pixels. 

20 After calculating the pixel parameters, VDM 

rendering of detailed geometry proceeds with method 
800 of FIG. 8 . 

Method 8 00, for each pixel, begins with 
step 802 whereat a silhouette determination is made. 

25 The VDM function includes an explicit representation 
of point visibility along the mesostructure 
silhouette. As explained, above, when ' d vdm = -1, then 



the corresponding line of sight intersects no 
detailed geometry. In this case, the corresponding 
pixel need not be processed and the. rest of the 
algorithm as illustrated in FIG. 8 is skipped. 
5 However, if the d vd m value is not . -1, the 
corresponding viewing direction ray would intersect 
with an underlying height field P' such as 
illustrated in FIG. 10. In one embodiment, for each 
pixel the nearest . sample value in texture space is 
10 used for silhouette determination. 

At step 804, a real texture coordinate for the 
pixel is calculated in order to obtain shading 
parameters stored in property maps . In particular, 
since properties of the detailed geometry are 
15 parameterized by texture coordinates on the planar 
re f erence . or sample surface, the actual texture 
coordinate of each mesostructure intersection point 
needs to be determined. In other words, the offset of 
P' from P in the texture space, needs to be 
20 calculated. 

For a planar reference surface, the offset 
between the real texture coordinate T' and original 
texture coordinate T ,-= (x, y) can. be computed as dT = 
avmiZ>y>0vAv>Cv)V*y where V xy = ( sm0 v cos0 v , sin0 v sin<|> v ) 
25 is the projection of the viewing vector onto the 
local tangent plane. For a curved reference surface, 
the texture offset can be' computed in the same way 
from the extended VDM displacement for curved 
surfaces as described above. 
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The real texture coordinate T" is then obtained 
by adding this . offset to the original texture 
coordinate T, i.e., T' = t + dT. 

At step 806 shadowing or occlusion is determined 
5 for each pixel by the height field. Shadowing of ; the 
intersection point from the light source . can be 
determined from the VDM representation. To better 
explain this step, a . discussion .will first be 
provided for a flat reference surface .900 / as 
10 illustrated in Fig. 9 . ' Let P be the mesh surface 
point and P.' be the intersection, point on t'he 
■detailed geometry. Let h denote the distance from p' 
to the surface as : given by the- mesostructure height 
field. The point P' represents the reference surface 
15 intersection of L passing through P' . 

Since the reference surface 900 is flat, the 
texture coordinate of P" can be geometrically 
determined as T = T + h • tan {Q L ) • L. The view- 
dependent displacement of P" = (x" , y") along is 
20 given by d L = c?vdm( x", y" , 0 L ,$ L , 0 ) .' 

The distance h • sec(9^) between P 7 and P" is 
compared to d L to determine the presence of shadow. 
When the two quantities are equal, P' . is in lighting 
or the light source is not occluded from P'; 
25 otherwise, P" is in shadow. 

For a curved object surface, the 
computation of T requires solving some, trigonometric 
equations . * : To reduce run-time computation, a table 
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indexed by the variables h, 0£ and c L could be built. 
However, the effect of curvature on shadow 
determination is generally unnoticeable , so it can be 
ignored. 

5 Depending on whether or not the pixel is in 

shadow, shading is. provided. In particular, if the 
pixel P 1 is in shadow, method flow proceeds to block. 
808 whereat an ambient color is . used, based typically 
on normal and material property maps defined on the 

10 same reference surface. If on the other hand, pixel 
P 1 is not in shadow, the pixel , color can be computed , 
at step 810 using a pre-defined reflectance model or 
other suitable technique.. 

In FIG. 8,. the output appearance of each pixel' 

15 based on the foregoing steps is quantified at step 
812. 

Having described obtaining a VDM representation 
and using the same for rendering, it may be helpful 
to consider implementation on a form of graphics 

20 hardware. In particular, the rapid development' of 
programmable, graphics hardware provides opportunities 
for real-time implementations of the VDM rendering 
algorithm. However, • for some forms of hardware some 
constraints may need to be overcome, examples of 

25 which are provided below. Nevertheless, it should be 
understood that implementation of the VDM rendering 
algorithm or method described above, or the VDM 
representation, is not intended to be limited to the 
discussion provided below. 



For some hardware platforms, the maximum 
dimensionality of texture maps can pose a problem for 
high-dimensional maps such as VDM . In addition, 
memory constraints can present an obstacle to the 
5 substantial amount of data in the VDM representation. 
For instance, mesostructure height fields of 
resolution 128 x 128 with 32 x 8 viewing , directions 
and 16 curvatures can be obtained. The corresponding 
64 MB of VDM data required may exceed some hardware 

,10 memory limits and thus cannot efficiently be loaded. 

To deal, with restrictions such as these, the 
data can be decomposed and compressed by singular- 
value decomposition (SVD). SVD. has the benefit that 
it can efficiently decompose a high-dimensional map 

15 into two lower-dimensional maps. Moreover, 
reconstruction is performed using only linear 
arithmetic operations, which can easily be handled in 
the hardware. For data with high correlation, a small 
number of eigen-f unctions is sufficient for . good 

20 * reconstruction . 

As described above in the VDM representation, 
when a ray along a view direction has no - intersection 
-with the mesostructure, it is labeled with the 
special value, herein exemplified as -1. When the 

25 silhouette exhibits high frequency, the number of 
eigen functions needed for acceptable reconstruction 
is dramatically .increased, which can lead to 
difficulties in hardware implementation. 
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To address this problem, an auxiliary 4D Maximal 
. View polar angle Map (MVM) is used. The MVM records . 
the boundary polar angle 9max for each position. For a 
densely sampled VDM, the MVM Q MVM (x, y,<f>, C)^max0 such* 
5 ; that V . : 

, dvD M (z, y, 0,4>,c)*-i ) 

where x, y are texture coordinates, § is the azimuth 
angle .of the -viewing direction, and c is the local 
curvature. After this computation, the -1 value of 

10 the corresponding polar viewing angle in the original 
VDM is in effect replaced with the distance for this 
maximum polar viewing angle. For some mesostructure 
samples by way of example, the MVM size is 4 MB, and 
combined with the VDM- data, the' total data size 

15 becomes 68 MB. 

The high-dimensional VDM and MVM are then 
reorganized into a 2D matrix 
A = [AvDMf Amvm] 

such that the rows are indexed by %,y,fyand the 
20 columns are indexed by <|> and/or c. Although these 
maps could be. differently organized for 
decomposition, experiments have shown that this 
splution can provide a good compromise between 
accuracy and storage. 

25 Applying SVD to A gives A =UkE T =WE T , Where E = 

[Evdm, Emvm] contains the eigen functions of A and W = 
UK contains the weights of the eigen functions. From 
this, the two maps can be expressed as 
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dvuMix, y, 0, 0,c) = 5>'Ur, y, </>) E' VDM (((), c) 
cW*, ^ 0,<t>,c) = ^<I>) e 'mvm(c) ' 

where . i indexes the . eigen functions in E and the 
5 * eigen function weights in W. Note that a common 
weight ;. function is used for the two maps to reduce 
storage . 

Since the eigen values decrease rapidly in 
magnitude, good rendering accuracy can be achieved 

10 with a small number of eigen functions. For example, 
only 8 VDM and 4 MVM eigen functions may be used for 
■- rendering the corresponding VDM data. By this 
decomposition and compression, the original 68 MB of 
VDM is reduced to 4 MB. 

15 In summary, a view-dependent displacement 

representation has been described to model surface 
mesostructure such as fine-scale shadowing, occlusion 
and silhouettes. Unlike other forms of displacement 
mapping, view- dependent displacement mapping 

20 represents displacements along the viewing direction 
instead of a mesh normal direction. A method of 
rendering high-dimensional texture ' mesostructures" 
using the view-dependent displacement was also 
provided that can be implemented on hardware 

25. graphics. 

Although the present invention has been 
.described with reference .to particular embodiments, 
workers skilled in the art will recognize that. 



• 24 ... 

. changes may be made in form and detail without 
departing from the spirit and scope of the invention. 




